Learning stochastic dynamics with statistics-informed neural network
نویسندگان
چکیده
We introduce a machine-learning framework named statistics-informed neural network (SINN) for learning stochastic dynamics from data. This new architecture was theoretically inspired by universal approximation theorem systems, which we in this paper, and the projection-operator formalism modeling. devise mechanisms training model to reproduce correct statistical behavior of target process. Numerical simulation results demonstrate that well-trained SINN can reliably approximate both Markovian non-Markovian dynamics. applicability coarse-graining problems modeling transition Furthermore, show obtained reduced-order be trained on temporally coarse-grained data hence is well suited rare-event simulations.
منابع مشابه
Self-informed neural network structure learning
We study the problem of large scale, multi-label visual recognition with a large number of possible classes. We propose a method for augmenting a trained neural network classifier with auxiliary capacity in a manner designed to significantly improve upon an already well-performing model, while minimally impacting its computational footprint. Using the predictions of the network itself as a desc...
متن کاملStochastic Dynamics of Learning with Momentum in Neural Networks
We study on-line learning with momentum term for nonlinear learning rules. Through introduction of auxiliary variables, we show that the learning process can be described by a Markov process. For small learning parameters and momentum parameters close to 1, such that = =(1 ?) 2 is nite, the time scales for the evolution of the weights and the auxiliary variables are the same. In this case Van K...
متن کاملLearning Document Image Features With SqueezeNet Convolutional Neural Network
The classification of various document images is considered an important step towards building a modern digital library or office automation system. Convolutional Neural Network (CNN) classifiers trained with backpropagation are considered to be the current state of the art model for this task. However, there are two major drawbacks for these classifiers: the huge computational power demand for...
متن کاملStochastic learning in a neural network with adapting synapses
We consider a neural network with adapting synapses whose dynamics can be analitically computed. The model is made of N neurons and each of them is connected to K input neurons chosen at random in the network. The synapses are n-states variables which evolve in time according to Stochastic Learning rules; a parallel stochastic dynamics is assumed for neurons. Since the network maintains the sam...
متن کاملStochastic functional population dynamics with jumps
In this paper we use a class of stochastic functional Kolmogorov-type model with jumps to describe the evolutions of population dynamics. By constructing a special Lyapunov function, we show that the stochastic functional differential equation associated with our model admits a unique global solution in the positive orthant, and, by the exponential martingale inequality with jumps, we dis...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Computational Physics
سال: 2023
ISSN: ['1090-2716', '0021-9991']
DOI: https://doi.org/10.1016/j.jcp.2022.111819